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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 1 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). / 

Status 

1)^ Responsive to communication(s) filed on 21 June 2007 . 
2a)Q This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) S Claim(s) 1-37 and 39-64 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) D Claim(s) is/are rejected. 

7) D Claim(s) is/are objected to. 

8) E3 Claim(s) 1-37 and 39-64 are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 1 1 9 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)DAII b)Q Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1 . This Office Action is made in response to applicant's amendment filed on 
6/21/2007. Claims 1-37 and 39-64 are currently pending in the application. An action 
follows below: 

Election/Restrictions 

2. This application contains claims directed to the following patentably distinct 
species: 

Species I: claims 1-32, drawn to a computer interface system with a 
spatiotemporal input data structure linking time and coordinate data from different input 
data. 

Species II: claims 33-37 and 64, drawn to a computer interface system with a 
display area disposed between an interactive space and a viewing space with a method 
of acquiring images toward the interactive space along an optical axis intersecting a 
central area of the display location. 

The species are independent or distinct because Species II has no requirement 
of needing a spatiotemporal data structure as described in the Species I, and Species I 
has no specific requirements of the arrangement of display space, viewing space, and 
interactive space, as described in Species II. 

Applicant is required under 35 U.S.C. 121 to elect a single disclosed species for 
prosecution on the merits to which the claims shall be restricted if no generic claim is 
finally held to be allowable. Currently, no claim is generic. 
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Applicant is advised that a reply to this requirement must include an identification 
of the species that is elected consonant with this requirement, and a listing of all claims 
readable thereon, including any claims subsequently added. An argument that a claim 

i 

is allowable or that all claims are generic is considered nonresponsive unless 
accompanied by an election. 

Upon the allowance of a generic claim, applicant will be entitled to consideration 
of claims to additional species which depend from or otherwise require all the limitations 
of an allowable generic claim as provided by 37 CFR 1.141. If claims are added after 
the election, applicant must indicate which are readable upon the elected species. 
MPEP § 809.02(a). 

Applicant is advised that the reply to this requirement to be complete must 
include (i) an election of a species or invention to be examined even though the 
requirement be traversed (37 CFR 1.143) and (ii) identification of the claims 
encompassing the elected invention. 

The election of an invention or species may be made with or without traverse. To 
reserve a right to petition, the election must be made with traverse. If the reply does not 
distinctly and specifically point out supposed errors in the restriction requirement, the 
election shall be treated as an election without traverse. 

Should applicant traverse on the ground that the inventions or species are not 
patentably distinct, applicant should submit evidence or identify such evidence now of 
record showing the inventions or species to be obvious variants or clearly admit on the 
record that this is the case. In either instance, if the examiner finds one of the inventions 
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unpatentable over the prior art, the evidence or admission may be used in a rejection 
under 35 U.S.C. 103(a) of the other invention. 

Applicant is reminded that upon the cancellation of claims to a non-elected 
invention, the inventorship must be amended in compliance with 37 CFR 1.48(b) if one 
or more of the currently named inventors is no longer an inventor of at least one claim 
remaining in the application. Any amendment of inventorship must be accompanied by 
a request under 37 CFR 1.48(b) and by the fee required under 37 CFR 1.1 7(i). 

3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Steven E. Holton whose telephone number is (571) 272- 
7903. The examiner can normally be reached on M-F 8:30-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amr Awad can be reached on (571 ) 272-7764. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 




AMR A. AWAD 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Steven E. Holton 
Division 2629 
October 15, 2007 



